A Benchmark and Empirical Analysis for Replay Strategies in Continual Learning

With the capacity of continual learning, humans can continuously acquire knowledge throughout their lifespan. However, computational systems are not, in general, capable of learning tasks sequentially. This long-standing challenge for deep neural networks (DNNs) is called catastrophic forgetting. Multiple solutions have been proposed to overcome this limitation. This paper makes an in-depth evaluation of the memory replay methods, exploring the efficiency, performance, and scalability of various sampling strategies when selecting replay data. All experiments are conducted on multiple datasets under various domains. Finally, a practical solution for selecting replay methods for various data distributions is provided.Comment: Accepted by CSSL workshop at IJCAI 202

Knowledge Distilled Ensemble Model for sEMG-based Silent Speech Interface

Voice disorders affect millions of people worldwide. Surface electromyography-based Silent Speech Interfaces (sEMG-based SSIs) have been explored as a potential solution for decades. However, previous works were limited by small vocabularies and manually extracted features from raw data. To address these limitations, we propose a lightweight deep learning knowledge-distilled ensemble model for sEMG-based SSI (KDE-SSI). Our model can classify a 26 NATO phonetic alphabets dataset with 3900 data samples, enabling the unambiguous generation of any English word through spelling. Extensive experiments validate the effectiveness of KDE-SSI, achieving a test accuracy of 85.9\%. Our findings also shed light on an end-to-end system for portable, practical equipment.Comment: 6 pages, 5 figure

Bonding dissimilar polymer networks in various manufacturing processes

Recently developed devices mimic neuromuscular and neurosensory systems by integrating hydrogels and hydrophobic elastomers. While different methods are developed to bond hydrogels with hydrophobic elastomers, it remains a challenge to coat and print various hydrogels and elastomers of arbitrary shapes, in arbitrary sequences, with strong adhesion. Here we report an approach to meet this challenge. We mix silane coupling agents into the precursors of the networks, and tune the kinetics such that, when the networks form, the coupling agents incorporate into the polymer chains, but do not condensate. After a manufacturing step, the coupling agents condensate, add crosslinks inside the networks, and form bonds between the networks. This approach enables independent bonding and manufacturing. We formulate oxygen-tolerant hydrogel resins for spinning, printing, and coating in the open air. We find that thin elastomer coatings enable hydrogels to sustain high temperatures without boiling

Brain Activation of Elite Race Walkers in Action Observation, Motor Imagery, and Motor Execution Tasks: A Pilot Study

Walking plays an important role in human daily life. Many previous studies suggested that long-term walking training can modulate brain functions. However, due to the use of measuring techniques such as fMRI and PET, which are highly motion-sensitive, it is difficult to record individual brain activities during the movement. This pilot study used functional near-infrared spectroscopy (fNIRS) to measure the hemodynamic responses in the frontal-parietal cortex of four elite race walkers (experimental group, EG) and twenty college students (control group, CG) during tasks involving action observation, motor imagery, and motor execution. The results showed that activation levels of the pars triangularis of the inferior frontal gyrus (IFG), dorsolateral prefrontal cortex (DLPFC), premotor and supplementary motor cortex (PMC and SMC), and primary somatosensory cortex (S1) in the EG were significantly lower than in the CG during motor execution and observation tasks. And primary motor cortex (M1) of EG in motor execution task was significantly lower than its in CG. During the motor imagery task, activation intensities of the DLPFC, PMC and SMC, and M1 in the EG were significantly higher than in the CG. These findings suggested that the results of motor execution and observation tasks might support the brain efficiency hypothesis, and the related brain regions strengthened the efficiency of neural function, but the results in motor imagery tasks could be attributed to the internal forward model of elite race walkers, which showed a trend opposed to the brain efficiency hypothesis. Additionally, the activation intensities of the pars triangularis and PMC and SMC decreased with the passage of time in the motor execution and imagery tasks, whereas during the action observation task, no significant differences in these regions were found. This reflected differences of the internal processing among the tasks